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^ (57) Abstract: A method of graphically displaying a result set according to the qualitative attributes of the result set is presented. 
A database stores a plurality of data items, each item identifying a content item stored on a netwoik accessible data storage device. 
Queries (1004) are executed within the database to collect a set of data items, each data it^m associated with a plurality of qualitative 



attributes (1006) which each r^>resent a quality of the content item identified by the data item. A coordinate graph (1026) is generated 
on each end users display device to display representations of the data items. The graphical display uses the spatial relationships 
(1016) among the data item representations to represent relationships among the data items based on two or more or their associated 
qualitative attributes. 
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METHOD AND SOFTWARE FOR GRAPHICAL REPRESENTATION OF 

QUALITATIVE SEARCH RESULTS 

COPYRIGHT NOTICE 
A portion of the disclosure of this patent document contains material which is 
5 subject to copyright protection. The copyright owiier has no objection to the fecsiroile 
reproduction by anyone of the patent document or the patent disclosure, as it appears in the 
Patent and Trademark OflBce patent files or records, but otherwise reserves all copyright 
rights whatsoever. 

BACKGROUND OF THE INVENTION 

10 The invention disclosed herein relates generally to search engines. More 

particularly, the present invention relates to the use of a graphical user inter&ce to present the 
result set retumed by a search. 

Traditional search engines, such as those used to search for content on the 
World Wide Web (WWW), execute searches by processing user-defined search terms 

15 coimected by conditional operators. Records retumed as part of a result set are listed and 
ranked based on the frequency of the search terms within the pages. Typically, the result set 
generated is a long list of web sites, with the desired pages lying several dozen entries within 
the set In addition, search engines cannot determine the context intended by the user, 
causing irrelevant pages that contain the term in an uiurelated context to be returned. 

20 Furthermore, because search engines base the result of their queries on the presence of search 
terms within a document, they are highly unsuited for searching image libraries, collections 
of motion picture clips, or other collections of non-textual information. 

Graphical user interfaces for search engines are known in the art that partially 
solve some of these problems. For example, U.S. Patent No. 5,982,369, assigned to Sony 

25 Corp., is entitled "Method for Diq>layingoa a Screen of a Conq>uterSystCT^ 

Representing Search Results". The Sony patent discloses a system whereby users enter one 
or more keywords to be searched on. The results are graphically displayed on a continuum 
with each end bearing a user supplied keyword. Results appearing on either extreme of the 
continuum are relevant only to the keyword associated with that end (i.e., "or^O while results 

30 appearing towiards the center of the continuum are relevant to botti keywords (i.e., "and**). 
This approach can be extended to two columns, depicted by two perpendicular lines 
representing four keywords. The results are fiirther laid out in a pyramid fashion with more 
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relevant results appearing towards the top of the pyramid and represented by a larger icon 
than the less relevant results, which appear as gradually smaller icons further down the 
pyramid in relation to their relevance. 

Another system directed towards the graphical representation of search results 

5 is U.S. Patent No. 5,636»350» assigned to Lucent Technologies, Inc., and entitled ^Using 
Symbols Whose Appearance Varies to show Characteristics of a Result of a Query^'. This 
patent describes a system for graphically displaying the results of a query on a grid where 
each dimension maps an attribute of the data representing factual infonnation about the 
results, e.g., journal name, journal year, title, author, etc. Records of the result set are plotted 

10 as symbols in the grid with the symbol's shape, size and color indicating characteristics about 
the record, such as the number of times the record contains a searched k^rv^ord. 

Neither of these systems is particularly well suited for use with non-text based 
content in which keyword searching is less important and meaningful than with text based 
content. While it is possible to display such non-text content according to its associated 

IS factual information, tiiis type of infomiation typically does not help users judge the quality of 
the content, either objectively or as judged by others. Instead, more meaningful decisions for 
this type of content are made based on qualitative attributes such as data describing or rating 
the quality of the content or data derived empirically from actions taken by or reactions of 
other users of the content. 

20 There is thus a need for a graphical search tool that presents qualitative 

attributes of a query's result set in a gr^hical manner, allowing users to quickly determine 
the most desired items in the set. 

BRIEF SUMMARY OF THE INVENTION 
It is an object of the present invention to provide a system capable of 

25 graphically presenting search results. 

It is another object of the present invention to provide a system that presents 
search results based on qualitative values of the content searched. 

■ - . • 

It is another object of the present invention to provide a convenient manner by 
which retrieved content may be selected and stored for later viewing. 
30 The above and other objects are achieved by a system that provides users with 

the ability to retrieve content items from a database using a database management system. 
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the relationship of the qualitative values of each record. Each content item stored in a 

database has a set of qualitative data associated with it Uscts select the quaUtative values \ 

upon \sduch to generate the graphical display, along with any optional filters, and are 1 

presented with a graphical display of the relative ranking of content items based on the f 

s 

5 selected criteria. : 

I 

A GUI generator controls the display of the result set oh an axis with j 
dimensions that conveniently translate the percentile values associated with each content item 
returned in the result set The user may also use the GUI generator to zoom in on the data : 

^ 

pomts displayed within the graph by appropriately selectmg the zoom in or zoom out control. 

i 

10 Alternatively, a marquee tool niay be used to select an area of the gjaph to zoom in j 

The GUI generator is further integrated with playback and collection tools, j 
which allows a user to select content items retumed by the search tool and add them to a | 
collection bin so that they can be viewed at a later date. The collection bin is presented as a j 

1 

set of thumbnail images, with each thumbnail representing an individual content item. 
15 Content items contained in the bin can be played by pressing a supplied play button, which 
will cause the content of the bin to play in order, or by double clicking on a specific 
thumbnail, which will play content items firom the selected point forward. Dragging the 
tiiumbnail from the bin onto the playback tool will play a single clip. 

Someoftheaboveandother objects ofthe present invention are also achieved by a j 

20 method that involves first collecting a set of data items from a network accessible database. ] 

\ 
t 

Each data item in the set contains a plurality of information that describes the qualitative j 

•• 

attributes of a content item. Additional data stored as part ofthe data item is also used to 1 

■ 

dynamically generate qualitative attributes for the data item. Representations ofthe collected | 

data items are arranged on a graphical display whereby the spatial relationships among the j 

25 data item representations represent relationships among the data items based on two or more j 

of their associated qualitative attributes. | 
Thescopeof the set of data iterascoUectedfix)m the database can be liinit^ The | 

search scope can be narrowed by retrieving only those data items that contain or are 1 
associated with one or more keywords. Furthermore, each data item is associated with one or \ 
30 morecategoriesthatcanalsobeusedtonarrowthescopeof thesetof dataiteiQsretu^ 

from die database. 
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The data item representations presented on the display are plotted on any number of 
coordinate systems. Exemplary coordinate systems include a x-y coordinate system, a x-y-z 
coordinate system, or two/three dimensional polar coordinate system. Where a x-y 
coordinate system is used, the data item representations are plotted on the x-axis according to 
one of the data item's qualitative attributes and on fhe y-axis according to a second qualitative 
attribute. Similarly, when the plot is on a x-y-z axis, the data item representations are plotted 
on the z-axis according to a third qualitative attribute of the data item. Whra the result set is 
displayed, each data item is assigned a color, depending on whether the data item inatch the 
keyword, category, or both, as supplied by the user. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The invention is illustrated in the figures of the accompanying drawings, 
which are meant to be exemplary and not limiting, in which like references are intended to 
refer to like or corresponding parts, and in which: 

Fig. 1 is a block diagram of a system for collecting search results and 
displaying them in a graphical user interface in accordance with one embodiment of the 
current invention; 

Fig. 2 is a screen display of a graphical search tool in accordance with one 
embodiment of the current inventioi^ 

Fig. 3 is another screen display of the graphical search tool showing a rollover 
window in accordance with one embodiment of the currmt invention; 

Fig. 4 is a flow diagram showing a process for graphically plotting a result set 
on a grid according to qualitative values in accordance with one embodiment of the current 
invention; 

Fig. 5 is a flow diagram showing a process of calculating popularity of a 
content it^ in accordance with one embodiment of tiie current invention; 

Fig. 6 is a flow diagram showing a process of calculating an average user 
rating in accordance with one embodiment of the current invention; 

Fig. 7 is a flow diagram showing a process for allowing users to zoom in on a 
region of a graphical display in accordance with one embodiment of the current invention; 

Fig. 8 is an exemplary screen display of the graphical search tool shown 
following execution of a zoom-in using the process set forth in Fig. 7; 
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Fig. 9 is a flow diagram showing a process for updating an average user rating 
for a content item based upon a rating input by a user in accordance with one embodiment of 
. the current invention; 

Figs. 10-1 1 are exemplary screen displays of one embodiment of the graphical 
5 search tool of the current invention developed for use with video clips; and 

Fig. 12 is a schema showing a database structure of one embodiment of a 
content database for use with the system of the current invention. 

DETAILED DESCRBPTION OF THE PREFERRED EMBODIMENTS 

FIG. 1 presents an overview of the components of one embodiment of the 
10 present invention. A database 102 is structured to hold information regarding content items, 
including content identifi^ such as the name of the content item, several fields to store 
qualitative information regarding the item, several fields to hold ke3^ord information, and 
several fields to store various categories to which the item belongs. The database may also 
include other miscellaneous data about the item, such as the number of times a content item 
15 has been viewed or the number of users who have chosen to rate an item. The table 

additionally holds an address, such as a URL, which points to the location where the content 
and associated thumbnail images are stored. 

As one skilled in the art wiU recognize, the database 102 may contain one or 
more tables and may have any desired structure. One embodiment of a database structured ais 
20 a relational database is shown in Fig. 12 and described in greater detail below. Alternatively, 
the database 102 may be an index of content available on multiple distributed computers, 
such as may be generated by Internet based search engines. A third embodiment involves 
utilizing an object-oriented database managemmt system i^ereby each contoit item is 
modeled as an object and the database is structured so as to reveal relationships between the 
25 objects. 

Software 1 04 facilitates interaction between users and the database 1 02. A 
database managemCTt system 104A is responsible for interacting with the database 102 and 
processing queries for records. A quality attribute generator module 104B uses data returned 
from the database 1 04 A to calculate certain qualitative attributes from the miscellaneous data 
30 stored in the database 1 02. Data produced by the attribute generator 1 04B serves as the 
coordinates of each record of the result set within a graphical display to be presented to a 
user. Exemplary processes performed by the quality attribute generator 104B module are 

5 
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described further below. The software components 104 may reside on a personal computer 
1 10 or the workstation upon which the database 102 also resides or other workstation which 
otherwise can access the database 102. Alternatively, the software may reside on a server that 
is accessible to various users over a network 1 12, such as local area network, intranet, 

5 extranet, or the Internet. 

The coordinates for each record are passed off to a graphical user interface 
(GUI) generator module 108, which plots the data onto a graph presented to the.us^ in 
accordance with processes described in greater detail below. After the user has examined the 
result set and selected a content item to view, the sofb^^re 104 uses the content locator, e.g., 

10 URL, returned with the content record from the database 102 to access the appropriate storage 
device 106 and deliver the content to the user. Storage devices 106 that warehouse the 
content items and associated thimibnail images may be located within the enterprise or 
accessible over a network 112, 

The GUI generator module 108 may reside in a personal computer 1 10, which 

IS could also contain the software 104 and/or database 102. Alt^nadvely, the GUI generator 
108 may further reside in remotely located computerized devices. For example, the GUI 
generator 108 can reside on a local area network 1 12 from where it can be accessed by a 
client workstation 116. Since the GUI generator 108 controls the display of the user 
inter&ce, terminals 118 located throughout the network can be used to access the system. 

20 When provided with access to the Internet, the software 104 can graphically deliver search 
results and coordinates to any number of ^'smart" devices, such as workstation PCs 116, set- 
top box devices 122, and wireless devices 124. The locally executing GUI generator module 
108 uses the data received to generate and di^lay the graphical interface as described ftirther 
below. In one embodiment, the GUI generator 108 is an applet that may be downloaded from 

25 a server upon which the software 104 resides. 

Turning to FIG. 2, an exemplary user interface according to the invention is 
presented. The primary component of the interface is the graph that a result set is plotted on 
206. Users have tiie abihty to select qualitative attributes 208 to plot a result set on, as well 
as the axis ^t each attribute is tied to. The attributes selected by the user appear on the 

30 appropriate axis 202 as indicated by the user 208. Controls are also provided for optioiial 
filters 210, such as category and keyword, which can be applied by the software 104 to limit 
the scope of the result set After a result set is returned, the data items in the result set are 
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represented by symbols, such as dots as shown, and plotted on ttie graph 206 accordmg to the 
values of the qualitative attributes that are being mapped. For example, a content item 204 
with a value of one for quality two and zero for quality one will be plotted on the graph 206 at 
(1,0). 

5 RefOTing to FIG. 3, a rollover window 302 is generated and displayed by the 

GUI generator when a user places the mouse pointer, or other selection device such as a pen 
or stylus, over a content item for several seconds or oth^wise selects a content item. The 
rollover window presents data regarding the content item, such as the value of any qualitative 
attributes that are not currently mapped, the author, the publication date, and any other 

10 miscellaneous data regarding the content item ihat is stored in the database. 

FIG- 4 presents a flow diagram outlining the process used to graphically 
piesent a result set according to the values of its qiialitative attributes. Uscts select the 
qualitative attributes that the result set is going to be plotted against 402. In one embodiment, 
the qualitative values that may be mapped on are rating, extremity, and popularity. Rating is 

15 the average value received by the content item by all users who have chosen to rate it 
Popularity is the item's popularity relative to all other items in the content database. 
Extremity is a rating assigned to flie content item by the system's administrator. These 
qualitative categories are exemplary, and not intended to be limiting, and one skilled in the art 
will realize that any number of qualitative values may be associated with each content item 

20 and stored in the database or generated based on empirical data stored in the database. In 
addition to selecting the qualitative values, the user must indicate (through the use of a series 
of radio buttons or other interface component that allows a user to make multiple non- 
exclusive selections) the value that maps to the x-axis and the value that maps to the y-axis. 

In some embodiments, each qualitative value has values fitting within the 

25 same predetermined range and are mapped on a scale representing that range, e.g., negative 
five to positive five. This allows for a single basic graph to be used for all gr^hical 
inter&ces and provides consistency to tisers. 

Users select the categories that will be returned by the search 404. In one 
CTibodiment, the software issues a query to the content database and receives a list of the 

30 unique categories contained therein, which is iised to populate category menus. Alternately, 
several categories may be hard-coded into tiie software and iq>dated periodically by the 

7 
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system administrator. The software is designed to manage several hundred tiionsand content 
items and the database schema is organized to facilitate the search of these items by category. 

Each content it^n in the system's database is also associated with one or more 
keywords. Providing keyword parameters narrows the scope of the result set to include only 
&ose content items that are associated with the entered keyword, or, for text-based content, 
contain the keyword in their title or descriptioiL Users are free to enter any type and number 
of keywords desired 406. An optional time frame restriction control is provided to add a date 
restriction to the search. 

After the user has set all the desired parameters for the search, tiiie query is 
executed 408. The GUI generator module 108 sends flie query to the database manager 
104A, which queries the database 102 and receives a result set comprising content items that 
either match the user selected category, keywords, or both. The database manager 104 A may 
then make a one-time determination to resolve whether the result set is comprised of records 
that contain a keyword match 410. In situations where the keyword supplied by the user fails 
to result in any matches, the software accesses an integrated thesaurus 412. Related words 
returned by the thesaurus module are used to replace the keywords entered by the user and the 
query is rerun 408. Once the result set is returned, the qualitative attribute gen^ator 104B 
executes a subroutine to determine the qualitative values and associated data for each item in 
the result set 414, in accordance with a process described further below. 

Data is placed into a data structure, with each element containing data for an 
individual record in the result set 416. The data structure is sent to the GUI generator module 
which traverses it and draws points on the search grid according to the qiialitative values the 
user has mapped to each axis 418. The user is now free to examine the result set that has 
been visually plotted according to the qualitative values of each content item. 

FIG. 5 presents a process of setting the coordinates for each content item in the 
result set for display on the search grid. The subroutine receives a result set containing the set 
of content items that match the keywords, categories, or both keywords and categories 
supplied by the user 502. If the result set is not null 504, arecord is retrieved and its data 
parsed 506. Control is then passed to a subroutine respoxisible for calculating an item's 
popularity 508. The subroutine will return, and the data for the current content item is 
returned to the main routine 510, including all qtialitative values and description data retumed 

with the item's record in the result set. The process returns to step 504 and the subroutine is 

• . ■■ ~ 
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repeated if there are more records in the result set to be processed. If the result set is null, i.e., 
all the records in the set have been processed and the data for each record's qualitative values 
passed to the main routine, the subroutine exits 512. 

Since the popularity of a content item is an empirically based qualitative 
attribute which changes each time a content item is retrieved, the popidarity is recalculated 
each time the item is loaded into memory. Referring to FIG. 6, a process of determining the 
popularity value for positioning within the grid is presented. First, the content item*s view 
count is selected from the record 602. Next, the result set is traversed to determine the view 
count for the content item with the highest view coimt (the "high view coimt") 604. The view 
count for the current item is then divided by the high view count 606. The result is multiplied 
by 10 and 5 is subtracted to arrive at a value for the item that fells within the rai^e of -5 and 
+5 608. The value is returned and the subroutine ends 610. 

The GUI generator also provides zoom functionality to view the data plot in 
greater detail. Referring to FIG. 7, the user indicates the desire to access zoom functionality 
of the software 702, e.g., by selecting a zoom tool icon from a GUI toolbar. The software 
determines if the user is attempting to "click" or "marquee'* zoom 704. Click zoom is where 
a user clicks the mouse at a certain location and the search grid performs a zoom on the point, 
whereas a marquee zoom is where the search grid zooms in on an area designated by draggiag 
the mouse over a particular area. For a click zoom, when the user clicks on a point in the 
gmph, the coordinates of the mouse position within the graph are used as a center point for 
the new display 706. Since the graph represents a finite set of data points, die zoom function 
will not retum results outside the original result set. This means that if a user clicks on a 
point near the edge of the graph, the search display will adjust the selected coordinates to 
compensate. 

For a click zoom, flie GUI generator determines the horizontal and vertical 
center point for the zoom-in 708 by applying the following calculations: • 



Table 1 


AdjX 


Detennine horizontal center 
point to 

use for zoom in 


If X<D/4, the AdjX=D/4 
IfX>(D-D/4),then 
AdjX=(D-D/4) 
Else AdjX=X 


AdjY 


Determine vertical center 
point to iise 
for zoom-in 


If Y<D/4, then Adj Y=D/4 
IfY>(D-D/4),then 
AdjY=(D-D/4) 
Else Adj Y=Y 
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The value of D is the pixel dimensions of the square graph, e.g., for a 200x200 graph, I>=200. 
AdjX and Adj Y are the adjusted coordinates for the new center point. After the new center 
point is calculated, the upper and lower bounds of the horizontal and vertical dimensions of 
5 the zoom are calculated 710 as follows: 





Table 2 




Xlow 


Lower horizontal boundary 

for zoom 

Range 


AdjX-D/4 


Xhigh 


Upper horizontal boundary 

for zoom 

Range 


AdjX+D/4 


Ylow 


Lower vertical boundary for 

zoom 

Range 


AdjY-D/4 


Yhigh 


Upper vertical boundary for 

zoom 

Range 


AdjY-D/4 



After calculating the values for Xlow, Xhigh, Ylow, and Yhigh, the GUI 
generator identifies the content items that fiiU within the zoom range by performing a 
comparison of the values against the new boundary points. Using this data, the GUI 

10 generator regenerates the display 712 with new pixel positions calculated for each data point 
and the routine will exit 718. Alternately, the formulas above can be calculated by taking the 
existing percentile values for each data point and translating the us^'s initial click 
coordinates into a percentile value. 

When executing a marquee zoom 704, the user drags the cursor across a 

IS section of the screen to zoom in on. Using the coordinates of the marquee, the software will 
calculate the horizontal and vertical center point for the zoom in 714 according to the 
calculations of Table 1 . The upper and lower bounds for the horizontal and v^cal 
dimensions of the zoom are calculated using the dimensions of the marquee area 716. The 
software then regenerates the display 712 and the zoom routine exits 718. 

20 FIG. 8 presents a zoom performed on the result set displayed in FIGS. 2 and 3 

with the mouse click and new center point being in the lower left quadrant of the x-y axis 
coordinate system. 

10 
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When viewing a content item, users are presented with an opportunity to 
provide a rating. FIG. 9 presents the process of determining the new average user rating for a 
content item. The number of us^ who have viewed a content item and the item's currrat 
average rating are retrieved from the database 902 and multiplied together 904. The new 

5 rating selected by the user is added to the product 906. The sum is then divided by the 
number of users who have viewed the item plus one 908. The resultant value is loaded into 
the database to reflect the new average user ratmg and total number of reviewers 910. For 
example, assume 500 people have rated a content item with an average rating of 2.2 and the 
current user is providing a rating of zero. The new average user rating would be deteraiined 

10 by the following calculation: 

((500 x2.2)+0)/501 = 2.19 
The new average user rating of 2, 1 9 is then loaded into the database along with the value 501, | 
to reflect the new total number of reviewers. 

Referring to FIG. 10, an overview of the major elements of one embodiment 

15 of the search tool is presented* Contained within the left panel of the display are controls 
1 002-1 010 through which the user may enter search criteria. The controls allow the user to 
decide which qualitative values to map the result set on, including the flexibility to dioose 
which axis each quality will map to 1 002. Through Ihe use of a pop-up menu or other similar 
input structure, users can choose one or more categories on which to focus their search 1006. 

20 The scope of the search may be further narrowed through the use of keywords 1004 and time 
frame 1008. A Control at the bottom of the panel allows the user to reset the search 
parameters 1012, which when activated will instruct the GUI generator to clear the search 
parameters entered into the GUI controls by the user. I 

A control is provided to execute the currently defined search 1014. When the | 

25 control is actuated, the keyword and category data provided by the user are passed to ttie | 

A 

database management system by the GUI generator. The data is used as query parameters in 
searching the database. After a search is executed, the nimiber of contebt iterns contained in 
the result set returned from the database and the parameters of the search provided by the user 
are displayed by the GUI generator in the upper rigjrt portion of the pane 1010. 
30 The center panel ofthe display contains the graph where the search result set 

will be plotted 1016 by the GUI generator. In one embodiment, the grs^h is comprised of an 
equal number of units in each quadrant with the origin in the center ofthe panel. 

11 



1 



B^SDOCID: <WO_022750aA1_L> 



J .1. ■''t-jL 



I 



wo 02/27508 



PCTAJSOl/30179 



Alternatively, the origin may appear anywhere within the panel, dedicating naore of the panel 
to a particular quadrant of the graph. The currently selected qualitative values on which the 
result set is mapped are displayed along two sides of the gr^h 1018. 

Content items 1 026 returned as the result set of a search are plotted within the 

5 graph 1016 according to their associated qualitative values ibat are being mapped to each axis 
on the graph provided by the GUI generator. For example, a content item with a rating value 
of 0, an extremity value of 0, and a popularity value of -5 is drawn at the origin when rating 
is tied to the x-axis and extremity is tied to the y-axis. Similarly, where rating is tied to the x- 
axis and popularity is tied to the y-axis, the same content item is drawn at (0, -5). When the 

10 mouse is placed upon a content item, a rollover window will appear. The GUI generator will 
render a window that will display information such as the titie, author or producer, die 
category that the content item belongs to, and the qualitative value or values that are not 
currentiy mapped on the grid 1016. 

The right side of the display is comprised of several tools: the legend 1020, the 

15 "more like this" tool 1 024, and the bin 1 022. The legend 1 020 contains the key to help 
determine the accuracy of the elements of the result set Each level of accuracy is associated 
with a distinct colpr. Several exemplary levels of accuracy are presented in the instant 
embodiment and include: result elements that match both the specified category and keyword, 
results that match the specified keyword, results that match the specified.category, and related 

20 content items. The GUI generator will appropriately color the content item representations to 
reflect each item's accuracy level as indicated by the legend 1 020. 

Below the legend is the ''more like this" tool 1 024, which is used to quickly 
retrieve similar or related content items. Dragging a content item 1026 fiom the grid 1016 
and dropping it on die tool will display a thumbnail image of the content item, retrieved from 

25 the database or other storage device storing the content, and use the item's categories and 
keywords as parameters for the search. Alternatively^ the mapped qualitative attributes may 
be used as the parameters for the search. The GUI generator will pass the parameters to the 
database management system to be used in formulating the new query. The database 

• • • • 

management system returns cont^t items that are similar to the selected item. The GUI 
30 generator will display the returned data items with the color reserved for related content 
items. 

12 
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The last tool in the panel is the bin 1022, which is a storage area for content 
items that may later be saved in permanent bins. The GUI generator allows users to drag a 
content item 1026 from the grid 1016 and drop it on a cell within the bin 1022. The GUI 
generator adds the selected content item to a file or otherwise marks it as added to the bin, 

5 and causes the thumbnail image to appear within the indicated cell. Alternately, the 
thumbnail and associated content item may be sequentially loaded into the next empty cell. 
The bin has controls that allow the user to save a bin, send a bin, and consecutively play all 
the content items currCTt in the bin. 

Turning to FIG. 1 1, an exemplary content viewing tool is presented. 

10 Information regarding the content item that is currently being viewed 1 102 occupies the 
majority of the left panel. Information presented includes: duration, publication or release 
date, the categories that the contmt item is a member of, a brief synopsis, and its qiialitative 
values (popularity, extremity, and mting). Below this information is a slider that allows a 
user to submit a user rating for the content item 1 1 04. By setting the slider to the desired 

15 rating and activating the sxibmit control, the GUI generator will transmit the value to the 
attribute generator, which will recompute the new average user rating and return it to the GUI 
generator for presentatiori to the user. Below the rating slider 1 104 is a control that allows a 
user to select a personal bin where the current content item can be saved 1 106. 

The center panel is divided into two sections: one containing a viewer 1 1 08 

20 used to playback the current content item and another used to display one of several personal j 
bins 1116 that may be created by the user. The GUI generator provides functionality that 
allows the user to select a content item cuirentiy held in the bin 1116 and drag and drop it on 
the viewer 1 108. This will cause the GUI generator to being playback of the content item 

Along the lower edge of the panel are controls 1110 that allow the user to save 

25 the bin, send the bin, and search for "more like this''. The send bin function will send an 
electronic mail message to the recipient indicated by the user. The message may contain a 
series of thumbnail images associated with the content items contained in the bin, along with 
an invitation to access the system to view the actual content items in their entirety. The | 
"more like this" function will return the user to the search tool depicted in FIG. 10, where tiie 

30 GUI generator will pass the parameters of the selected content item to the database 

management system. The database management system will execute the query and return the 
result set to the GUI generator for visual presentation by die GUI generator on die grid 1016. 
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The rightmost panel contains a quick search tool 1 1 14. By entering keywords 
and selecting a category, the user will return to the search tool. The GUI generator will pass 
the parameters off to the database management system, which will execiite the query and 
retum the result set to the GUI gen^tor. The GUI generator will use the data contained in 

s the result set retumed fix)m the database management system to update the contents of the 
search results pane 1010 and the grid 1016. Below this is the temporary bin 1112 containing 
content items retrieved fix>m tiie grid 1016 and placed in the bin 1022. 

Fig. 12 shows a database schema of a relational database structure used to 
support one embodiment of the present inventiorL As the schema reveals, the database is 

10 comprised of a number of related tables 1200, with each table in turn comprised of fields 
configured to store data regarding a particular piece or feature of the system. As can be seen, 
the schema is primarily composed of two major tables, or entities, that hold data regarding 
users 1202 and content itemsl204, in this case video files. 

Each record held in the video table 1204 contains data regarding a particular 

15 content item's identification number, location (e.g., URL or file system address), title, and 
producer. The records further contain qualitative attribute data such average rating and 
extremity, as well as with additional data such as view count and ratings coimt that, as 
described above, are used to generate additional empirical, qualitative attributes. Each record 
in the video table is also associated with one or more records contained in category tables 

20 1206 containing category data that is structured or organized in a hierarchy of parent and 
child categories. 

The other major element of the schema is the user table 1202. These records 
contain data regarding all system users, including the system usoname, password, email 
address, and the speed ofthe user's Intemet connection. The table also contains data 

25 concerning the xiser's identity (first and last name) and city, state, zip code, and country. 
Each record in the user table is associated with one or more collections or bins 1208. Each 
bin» in turn, is associated with one or more videos (content items) 1210. This collection of 
relationships allows each user, through the interface to the system provided by flie GUI 
generator, to create and save a plurality of bins, each containing a plurality of videos. 

30 While the invention has been described and illustrated in connection with 

preferred embodiments, many variations and modifications as will be evident to those skilled 
in this art may be made without departing firom the spirit and scope of the invention, and the' 

14 
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invention is thus not to be limited to the precise details of methodology or construction set 
forth above as such variations and modification are intended to be included within the scope 
of the iuvention. 



15 



0e27508A1J > 



wo 02/27508 



PCT/USOl/30179 



WHAT IS CLAIMED IS: 

1 . A method for graphically displaying a result set, the method comprising: 
collecting a set of data items identifying content data, each data item being 

associated with a plurality of qualitative attributes which each represent a quality of tiie 
5 content data identified by the data item; and 

displaying representations of the data items in a graphical display which uses 
. spatial relationships among the data item representations to represent relationships among the 

data items based on two or more of their associated qualitative attributes. 

2. The method of claim 1, wherein the step of displaying the data item 
10 representations comprises plotting the data item representations on a coordinate system. 

3. The method of claim 2, wherein the step of plotting the data item 
representations comprises plotting the data item representations on a x-y axis. 

4. The method of claim 3, wherein the step of plotting the data item 
representations comprises plotting the data item representations on the x axis in accordance 

15 with a first of the associated qualitative attributes and plotting the data item representations 
on the y axis in accordance with a second of the associated qualitative attributes. 

5. The method of claim 3, wherein the qualitative attributes have values all of 
vsdiich fall within a predetermined range, and wherein the step of plotting the data item 
representations on the x-y axis comprises displaying the x and y axes out to the 

20 predetermined range. 

6. The method of claim 3, wherein the step of displaying the data item 
representations comprises displaying an origin of the x-y axis at or about at a center of the 
graphical display. 

7. The me&od of claim 3, wherein the step of displaying the data item 

25 representations comprises plotting the data item representations in three dimensional form on 
a x-y-z axis system. 

8. The method ofclaim 7, wherein the step ofplotting the data item 
representations comprises plotting the data item representations on the z axis in accordance 
with a third of the associated qualitative attributes. 

30 9. The method of claim 1, wherein the step of collecting the data items 

comprises searching for the data items as a subset of a group of data items. 

16 
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10. The method of clahn 9, wherein the step of searching comprises searching . 
for data items identifying content data containing or associated with one or more keywords. 

1 1 . The method of claim 9, \s^erein the step of searching comprises searching 
for data items identifying content data having one or more categories associated therewith. 

5 12. Themethodofclaim9, wherein the step of displaying the data items 

w 

comprises assigning a first color to each data item representation indicating satisfaction of the 1 
search and displaying the data item representation in the assigned color. ^ 

13 • The method of claim 1 , comprising allowing a user to select a first data j 

4 

; 

item representation in the graphical display and presenting the content data identified by the j 

« 

■i 

10 first data item. ! 

14. The method of claim 1, comprising storing the data items in a database in | 
association with additional data and generating one of the qualitative attributes for each j 
collected data item based upon the associated stored additional data. j 

1 5 . The method of claim 1 , wherein the graphical display has first boimdaries, : j 
15 comprising generatii^ a second graphical display having second boimdaries different th j 

first boimdaries and displaying one or more of the data item represmtations in the second 
graphical display. 

1 6. The method of claim 1 5, wherein the step of generating the second 
graphical display comprises generating the second graphical display such that the second 

20 boundaries fall entirely within the first boundaries. 

17. The method of claim 16, comprising determining which one or more of 
the data item representatioxis to display in the second graphical display based \spon the second 
boundaries. 

18. The method of claim 15, comprising allowing a user to select a point or 
25 region in the graphical display and determining the second boundaries as a fimction of the 

selected point or region. 

1 9. The method of claim 1 , comprising, in response to a user action in relation 
to a given displayed data item representation, displaying a rollover window containing 
additional information regarding the given data item. 

30 20. The method of claim 1 9, wherein the step of displaying the rollover 

« 

window comprises displaying values of any qualitative attributes of the data itCTtt not already 
represented in the graphical display. 

17 
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21 . The method of claim 1 , comprising allowing a user to select a plurality of 
the displayed data items for storage in a data file. 

22. The method of claim 1, wherein the data items are each associated with 
three or more qualitative attributes, comprising allowing a user to select two of the three or 

5 more qualitative attributes for use in displaying the graphical display.. 

23. The method of claim 1, comprising: 

selecting a displayed data item representation having first values of associated 
qualitative attributes represented in the gr^hical display; and 

collecting one or more additional data items having second values for 
10 associated qualitative attributes identical or similar to the first values. 

24. The method of claim 1, wherein the qualitative attributes consist of one or 
more of the following: an average rating of the content data, popularity of the content data, 
and an extremity rating of the contrat data. 

25. A system for graphically displaying a result set, the system comprising: 

15 a database for storing information regarding content items and from which the 

result set is returned; 

a quality generator for calculating display coordinates for records in the result 
set returned from the database according to their qualitative attributes; and 

a iiser interface module for displaying a graph of said result set using the 
20 display coordinates generated by said quality generator. 

26. A computer readable medium for storing a program which, when executed 
on a computer, causes the computer to perform a method for generating a graphical user 
interfrice, the method comprising: 

receiving a data structure comprising a set of data items identifying content 
25 and a plurality of num^cal values associated with the data items and representing qualitative 
attributes of the content data; and 

mapping a representation of each data item onto a graphical display based 
upon the associated numerical values for two or more of the qualitative attributes. 

27. A computer systmi comprising: 
30 a di^lay device; and 

a processor executing a program for generating a graphical user interface on 
the display device, the program performing the steps of: 

18 
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receiving a set of data items identifying content data, each data item 
being associated with a plurality of qualitative attributes which each represent a quality of the 
content data identified by the data ifem; and 

generating representations of the data items in a graphical display 
5 which uses spatial relationships among the data item representations to rq)resent relationships 
among the data items based on two or more of their associated qualitative attributes. 
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